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Tt. Introductipn 


As science advances, with the resultinn advances in technolocy, we 
have new tools and new cavabilities which influence our world in manv 
wavs. This new technolocy not only influences the traditional art forms 
but also vrodures new forms of art. The develooment of hirh seed elec- 
tronic components and circuits, the cathode rav tube, the video camera, and 
inexvensive video tape recorders enabled the development of video art. ‘The 
developnent of small but powerful comouters now allows systems to he ce- 
veloped which san eive the video artist a new dimension of control over the 
video image. #ith a computer-based video synthesizer (C3VS), one can 
generate a Sequence of imases while controlling each indiv; dual image with 
detail and prerision that is nany orders of marnitude creater than is 
possible with manual cantrol. 

The ability to control the dynamics of the inare is useful to the 
artist only if the system is capable of seneratinre the inase in real tine. 
With this requirement in mind, the natural choice of devices for conver- 
tine electrical signals to visual images is the conventional video System... 
This choice also gives the capability of recordins the video compositions 
with a conventional video tape recorder and of broadcastins to a larpe 
audience throuyh existine network systems. 

There are basically two modes of operation of the system: inter- 
active compositional mode and automatic production mode. In the compo- 
sitional mode, the artist can enter prorrams and parameters throurh the 
keyboard, observe the resultinre sequence of imares, and then modify p2ra- 
meters through either the keyboard or a real time input and thus build 
up 3 data set for a complete pjece. At each stape of the compositicn 
process the data set, representinr all the aesthetic decisions made Dy 
the artist, is stored in the computer. When the composition is finished 
the system will overate in the automatic production node reneratinre the 
final video sijnal in real tine with no intervention by the artist. The 
artist may also choose to use a combination of these two modes in an 
interactive performance or allow.an audience to interact with the svsten 
operating automatically. The system is structured so that all of. these 
variations can be accomodated by appropriate programminc. 

The systen may be operated as a generating synthesizer which produces 
a video sirnal entirely from internal sirnals or as a processing synthe- 
sizer which utilizes sirpnals of external origin such as a video canera. 
Either of these two types of operations is carried out by a conficuration 
of element modules, each of which performs a class of functions, with the 
specific function durine one frame beinr determined by the control parameters 
received from the comouter. 

Since the computer functions only to penerate the parameters which 
govern the behavior of the synthesizer modules, a video sipnal will be 
csenerated without operation of the computer. The system will simply repeat 
the frame unti} the parameters are changed. Thus the artist may choose 
to stop the computer in which case he is able to examine a single frame, 
or he may alter the program so that a given sequence is displayed very 
slowly or repeated very rapidly. 
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II. System Structure 


The CBVS consists of two parts: the computer section shown in the 
lower section of figure 1 and the video section shown in ‘the upper section 
of the fipure. 3oth sections operate simultaneously and independently, 
communicatine throueh the buffer memory which has a capacity of 1,024 
16 bit words. Fach of these words is either a picture element, a number 
which controls some function of the video section and determines some 
aspect of one field of the video inage, or it is a picture feature, a 
number determined by the video section and may depend on an external 
Sirnal such as a video camera siznal. The buffer menory is connected 
to the computer bus throuch a 16 bit parallel interface which is struc- 
tured in such a way that each word in the buffer memory is addressable 
and may be read or written in exactly the same way as words in the main 
computer memory. This memory-mapped I/9 system simplifies the software 
which controls the buffer memory. In order to undate an element such 
as a control D/A, the computer must execute an instruction which stores 
the new value in the location correspondinr to that element. 

During the active scan time, the control computer reads features 
from the buffer menory and generates elements for the folfowine field and 
stores them in the buffer memory. Durine the vertical blanking interval, 
information is transferred through the element bus from the buffer memory 
to the element modules or from the feature modules to the buffer memory. 
The desirnation of a particular area of the buffer memory as an element 
or feature is under program control. Durine the transfer between the 
buffer memory and the element bus, the computer is locked out of the buffer 
memory. On completion of the transfer, the interface renérates a vectored 
interrupt which requests the computer to generate paranetérs for the next 
field. 

The computer system consists of: a DEC LSI-11 microprocessor which 
has a 16 bit word leneth and an instruction execution tind of about 7 
microseconds; Teletype Keyboard and printer connected threuch a serial 
interface; 20 K of dynamic memory: a dual drive floppy disk system with a 
capacity of 256,256 bytes ver diskette. An additional serial interface 
is also available for connectinz through a modem to other computer systems. 
The entire system is dedicated to the synthesizer systen. 

The overall timine is determined by a 9.7552434 ‘IHz ¢lock which is 
phase locked to the subcarrier (3.579545 MHz). This freavency is chosen 
to insure a coherent subcarrier and to divide the active sortion of the 
scan line into 512 pixels. The red, creen, and blue sirnals are venerated 
indenendently, and the chroma encodinr is done with analos circuits, thus 
there is no advantage to followins the common practice of makinre the pixel 
rate an interer multiple of the subcarrier frequency. With this clock 
frequency, a full nine bit word is used to define the horizontal position 
on the active portion of the raster. Firure 2 shows the X and Y wave forms. 
The X-Y module penerates twenty bits of timing information (ten bits ‘or 
horizontal, includins the blankine period, and ten for the line ccunt). 
This module also senerates sync, drive, burst flars,jand the transfer request 
TR sicnal which controls the timing of the buffer memory. 











NEA Report 


Timine details of the interface and buffer memory are shown in f*rure 
3. The transfer request TR voes low at the berinning of vertical blankine 
initiatine an arbitration for access to the buffer memorv. If the conmouter 
is accessine the buffer memorv, the current bus cycle is completed, then 
PEADY roes hieh, and the buffer memory controller cvcles throuch menory 
makine, the required elenent and feature transfers. ‘Yhen this is completed, 
PEADY goes low, control of the memory is returned to the comouter, and an 
interrupt is venerated requestins data for the followinre field. As in- 
dicated in the diacram, durine the Nth field, the comnuter is rseneratinr 
data for the N+tlth field. 

The timings of the sicnals on the element bus are indicated in fi7ure 
4. During the transfer, the menory controller renerates: the addresses 
Ag -A ; the clock sirnals B, ’ f', » and Ps ; and the status sicnals 
CME indicating a transfer from the nemory to an element and CFM indicatine 
a transfer from a feature module to the memory. The sie¢nals ETF and FTS 
are eenerated by the synthesizer modules and initiate a controller Flenent/ 
Feature mode change. The three phase clock system is used to control modules 
which have the structure shown in firure 5. Functions which use data from 
the compurer during the vertical blankine interval are disabled when the - 
buffer mennory accesses that particular element by a sirnal penerated usine 

g, - This allows access to the buffer menory during Po . The third clock, 

Ps, penerates a memory write si7nal. 

Time celays in the dicital processins modules could produce errors 
and shifts of the imare to the richt. This is prevented by deskewince the 
output of each with a latch clocked by the master clock (9.755 ‘“tiz.). 
Compensation for the resultinr 102.5 nSec. delay in each module is provided 
by starting the X count at the besinninz of the horizontal blankine interval 
rather than at the end. An additional shift to the right or left is then 
achieved by adding (mod 512) a constant supplied by the computer. The default 
value of his constant is 404 + number of elements. 


III. Element and Feature Modules 


The structure described above supports a variety of elenent and feature 
modules which nav be chosen and confirured accordine to the tastes of the 
artist. ‘ur experience indicates that a larre amount of work can be produced 
with a relatively small number of elements in a standard confiruration. ‘Then- 
ever possible, a new element added to the system is confirured in such a way 
that if the control word is set enual to zero it has no effect on the systen. 
Thus 2 minimum amount of reprorrammine is required followinr systen expansion. 

Two zeneral classes of modules have been developed: digital ane hybrid. 
The hvbrie elements are: hnich-speed 2/4 converters used for seneratin® the 
rea, sreen,and plue video sisnals which are converted to NTSC format in the 
gtandard wav: low-sdeed D/4 converters used for reneratine control voltares, 
field-by-field controllable, used to onerate existing voltaze controlled 
analos imarpe processinr systems such as keyers, raster ranipulaters, etc. 
Another hybrid element is the analoer video switchinr matrix. Four bits cf 
one contnol word are used to select one of sixteen inputs for one output. 

Dirital processinr elements include: constant; X + constant; Y + constant; 
twelve-channel sixteen-line demultiplexer with output complement; and four- 
channel fiour-bit by sixty-four word memory. 
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X and Y Half Cycle Durations and Wave Forms 
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Figure 3 
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Firure 4 
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